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Consequential Validity Impact of Choosing Different 
Aptitude-Achievement Discrepancy Models in Identifying 
Students with Learning Disabilities^ 

The lack of consistent, universally acceptable procedures for identifying children 
with learning disabilities continues to plague persons and agencies with educational 
responsibilities to these children. While the majority of LD identification procedures 
involve sequential steps of successive screening, diagnosis and confirmation through 
multiple assessments, historically, one commonality exists in most guiding policy 
regulations and in practice; a “severe discrepancy” in aptitude and achievement in defined 
areas must be demonstrated. The latter aptitude-achievement discrepancy has been the 
most commonly agreed upon and accepted primary criterion and indicator of a learning 
disability. While much discussion has occurred historically in the literature on 
appropriate procedures (e. g.. Cone & Wilson, 1981; Shepard, 1980; Willson & Reynolds, 
1985) and the whole notion of aptitude-achievement discrepancies is currently being 
reassessed (Bradley, Danielson & Hallahan, 2002; National Joint Committee on Learning 
Disabilities, 2002; Peterson & Shinn, 2002), the fact remains that alternative procedures 
for calculating aptitude-achievement discrepancy scores continue to be implemented and 
used as primary indicators of eligibility for LD services. Each procedure defines a severe 
discrepancy based on a different formula and criterion value, thus operationally defining 
LD in different ways and identifying students at different rates and of different ability 
levels. 



Through a series of computer simulation studies, the intent of the present paper is 
to: 1) provide information on the percentage of students with learning disabilities (LD) 
expected to be identified under different aptitude-achievement discrepancy eligibility 
models and criteria, and 2) demonstrate the consequential effects in terms of the extent to 
which the different models identify students of different ability levels. The two primary 
models of concern in the comparisons were the regression discrepancy model and the 
straight discrepancy model. In addition, a third model, the true score discrepancy model. 
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was included in the comparisons as it attempts to adjust the straight discrepancy model 
for unreliability of the aptitude and achievement scores. 

To comparatively evaluate the identification rates for the models investigated, 
data with predetermined parameters were generated to simulate conditions mirroring 
those found in actual practice. In applying each of these models, the resulting selection 
rates are dependent on several other parameter values that need to be considered in any 
simulation of data. For the regression discrepancy model, the criteria for eligibility 
' changes as a function of the correlation between the aptitude and achievement measures. 
For the straight discrepancy model, the criteria for eligibility changes as a function of the 
reliabilities of the aptitude and achievement measures. For the true score discrepancy 
model, the criteria for eligibility change as a function of both the correlation between the 
aptitude and achievement measures and the reliabilities of both measures. 

Methods and Techniques 

Given that each of the model's criteria for detenuining eligibility is dependent on 
either the correlation between the aptitude and achievement measures or the reliabilities 
of the measures or both, each of these parameters needed to be included and manipulated 
in the simulation studies. Based on the literature and the normative information in 
various aptitude and achievement test manuals, correlation and reliability values for the 
simulations were selected to represent the full range of possibilities of those that would 
likely be observed in practice. In generating the simulated data, four base data sets were 
generated for samples of 10,000 cases each. In these data sets, aptitude and achievement 
scores were generated to create normally distributed scores with a mean of 100 and a 
standard deviation of 15. Making the data sets unique were the correlations specified 
between the aptitude and achievement scores for the 10,000 cases within a data set. The 
aptitude/achievement correlation coefficients defining the data sets were set at values of 
.75, .55, .35 and .15. 
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For these data sets, appropriate procedures were used to obtain regression, straight 
and true discrepancy scores for each case. Discrepancy scores were obtained by 
subtracting each case's achievement score from their aptitude score. To obtain the 
regression discrepancy score for a case, a regression equation was developed with 
achievement as the criterion score and aptitude as the predictor. Predicted achievement 
scores were obtained from which the actual achievement scores were subtracted to get the 
regression discrepancy score for a case. In calculating the true discrepancy scores, the 
reliabilities (rapt and Tach) were used to adjust the discrepancy between aptitude and 
achievement for errors in measurement. The fonnula used was; 

True discrepancy = rapt (apt score - 100) - rach (ach score - 100). 

To obtain these scores, the reliabilities for the aptitude and achievement measures were 
varied across the values of .95, .85, and .75, thus creating nine true discrepancy scores 
from the ordered pairwise combinations: (.95, .95), (.95, .85), (.95, .75), (.85, .95), (.85, 
.85), (.85, .75), (.75, .95), (.75, .85), and (.75, .75). 

The criterion levels to define the size of a discrepancy needed to qualify a student 
for services are determined by the standard error of estimate for the regression 
discrepancy scores, by the standard error of measurement for the straight discrepancy 
scores and by an adjusted standard error of measurement for the true discrepancy scores. 
The standard error of estimate (SEE) in the regression discrepancy model is a function of 
the correlation between the aptitude and achievement scores, i. e., 

SEE=15(l-r2ap,_a,h)'“ 

The standard error of measurement in the straight discrepancy model (SEM) is a function 
of the reliabilities of the aptitude and achievement measures, i. e., 

SEM=15(2-r,pt-r,,h)'^^ 

The standard error of measurement in the true discrepancy model (SEMT) is a function of 
both the correlation between the aptitude and achievement scores and the reliabilities of 
the two measures, i. e., 

SEMT - 15 (r^apt ''' ^ach ' ^ ^apt ^ach ^apt,ach) • 
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To obtain the SEM and SEMT values, the reliabilities for the aptitude and 
achievement measures were varied across the values of .95, .85, and .75, thus creatirig 
SEMs and SEMTs for the nine aptitude-achievement discrepancy score configurations: 
(.95, .95), (.95, .85), (.95, .75), (.85, .95), (.85, .85), (.85, .75), (.75, .95), (.75; .85), and 
(.75, .75). Once obtained, each of these values was then multiplied by the appropriate z- 
score from the noraial distribution that would identify a fixed percentage of students that 
are expected to have discrepancy scores as large as the criterion value deteraiined. The 
current simulations examined the identification rates for z-score values of 1.5 (7%), 1.65 
(5%), and 1.96 (2.5%). Table 1 gives the criterion scores using the above procedures for 
each model under each configuration of aptitude/achievement correlation, aptitude and 
achievement reliabilities and z-score criterion levels. For any one value in Table 1 , if the 
discrepancy score derived from the model for a student exceeds that value, then the 
student qualifies (meets this component's eligibility criteria) for services. As noticeable 
in Table 1, the regression model criterion score is constant for a fixed correlation value, 
but varies across correlation values, the straight discrepancy model criterion score varies 
as a function of the reliabilities, but is the same when the sum of the reliabilities is the 
same (e. g., (.95,.75), (.75, .95) and (.85, .85)) and across correlation values, and the true 
discrepancy score model criterion score varies across all conditions. 

Results and Conclusions 

The results of the primary model comparisons are presented in Tables 2-13. 
Provided are the estimated proportions (percentages) that would be eligible under each of 
the three models for all conditions which were varied in the simulation studies. 

Estimated eligibility percentage values are given for different ability groupings in each 
table so that the trend can be observed for each model as ability level increases. Also, the 
overall eligibility rate is presented for three conditions: 1) for all 10,000 cases in a data 
set; 2) for cases with only ability scores of 80 or greater; and 3) for cases with only 
ability scores of 85 or greater.' The latter values were included as some LD eligibility 
models have a minimum aptitude (ability) requirement to qualify for services in addition 
to meeting the aptitude-achievement discrepancy requirement based on the modeljn use. 
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The presentation of the simulated results in Tables 2-13 are arranged 
systematically in that the results are presented within sets categorized by the z-score 
criterion level. That is, Tables 2-5 present results when the z-score criterion was set at 
1.5 (approximate 7% rule), Tables 6-9 present results when the z-score criterion was set 
at 1.65 (5.% rule), and Tables 10-13 present results when the z-score criterion was set at 
1 .96 ( 2 . 5 % rule). Within each of these sets, the tables are ordered by decreasing 
aptitude/achievement correlation values, i. e., .75, .55, .35 and .15. It should be noted that 
in a given table, there is only one set of results for the regression discrepancy model as its 
standard error is constant for all reliability combinations and that some of the values 
repeat themselves for different combinations of the reliabilities for the straight and true 
score discrepancy models. What the latter illustrates is that while the 
aptitude/achievement reliability combinations may define different conditions, the effect 
is the same within a given model. 

The data in selected tables (9 and 6) are graphically illustrated for selected 
conditions in attached Figures 1 - 4 (Table 9 results) and 5-8 (Table 6 results). Figures 
1 and 5 illustrate the basic differences in the regression versus the straight discrepancy 
models when aptitude/achievement are correlated .15 and .75, respectively and a z-score 
of 1.65 (5% rule) is used as the criterion level. These two figures are the simple scatter 
plots of the aptitude and achievement scores from the respective data sets. The solid lines 
represent the regression lines as assumed in each model. The straight discrepancy model 
assumes that aptitude and achievement are correlated perfectly (r = 1.00). The dotted 
lines represent the standard error criterion score values from Table 1 such that if a 
student's achievement score falls below the dotted line for that model, his/her 
aptitude/achievement discrepancy based on the model would qualify him/her for LD 
services. The dotted line for the straight discrepancy model represents the most extreme 
condition with the largest standard error, one where the aptitude/achievement reliabilities 
are .75 for the two measures. 

Figures 2-4 and 6-8 further illustrate the effects across ability levels for 
aptitude/achievement correlations of .15 and .75, respectively. These figures plot 
discrepancy scores from each of the models against aptitude scores. Two vertical lines at 
aptitude scores of 80 and 85 are presented in each figure to illustrate which discrepancy 
scores would exceed the criterion levels for cases with aptitude scores greater than or 
equal to scores of 80 and 85. The horizontal lines in the figures represent the standard 
error .CDterion discrepancies needed for a case (data point) to qualify as being eligible. 
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Any data point above the line represents a case that meets the eligibility criterion. Two 
lines are presented for the straight discrepancy scores (Figures 2 and 6), each representing 
the extremes possible, i. e., reliabilities of .95 or .75 for both measures. The true score 
discrepancy condition presented is when the reliability of the aptitude measure is .75 and 
the achievement measure is .95. The latter was the most favorable condition for true 
scores. 

Certain trends illustrated in Tables 2-13 and Figures 1 - 8 are readily apparent. These 
include: 

1 . The straight discrepancy model always identifies substantially more cases as being 
eligible than do either of the other two models except under the one condition when 
the aptitude/achievement correlation is .75 and the aptitude/achievement reliabilities 
are .75 and .75. The proportions identified for this model increase substantially as the 
ability level increases. The disparity between this model and the other two models is 
greater if the reliabilities are higher (the standard error and therefore the criterion 
score that determines eligibility is smaller) and this disparity increases as the 
aptitude/achievement correlation becomes smaller. 

2. The regression discrepancy model identifies a constant proportion of individuals at the 
rate set by the z-score across all ability levels. 

3. The true discrepancy score model identifies a constant proportion of individuals at the 
rate set by the z-score, but does so disproportionately across ability levels with very 
few cases selected at the lower ability levels and the majority selected coming 
disproportionately from the higher ability categories. 

To further illustrate the differences in the models. Table 14 presents the "hit and miss" 
rates comparing models for students meeting the eligibility criterion for a model. Given 
in the tables are the percentages of students identified by one of the models, but not the 
other and the percentages of students identified by both the models. Comparisons of the 
straight discrepancy to the true score discrepancy model is not included as those students 
identified by the straight discrepancy model always included those identified by the true 
score model, but in addition identified substantially more as being eligible. These 
percentages are based only on those students with aptitude scores greater than or equal to 
80. The sample size for these groups was approximately 9000 cases. 
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The compatible figures to the information in Table 14 are Figures 9 and 10. These 
figures show the scatter diagrams for the plots of the straight discrepancy versus the 
regression discrepancy scores for aptitude/achievement correlations of .15 and .75, 
respectively. The standard error criterion levels are shown by the vertical and horizontal 
lines in the graphs. Again, two vertical lines are given to represent the two extreme 
discrepancy score standard error criteria, i. e., when reliabilities are set at .95 or .75 for 
both measures. Data points above the horizontal line identify those cases that meet the 
regression model criterion and data points to the right of the vertical lines meet the 
straight discrepancy model criterion. The intersections of the vertical and horizontal lines 
divide the graphs into four quadrants. The upper left quadrant illustrates those cases that 
meet the regression model criterion for eligibility, but not the straight discrepancy model 
criterion (designated as 0,1 in Table 14). The lower right quadrant illustrates the opposite 
result, those cases that meet the straight discrepancy model criterion, but not the 
regression model criterion (designated as 1,0 in Table 14). The upper right quadrant 
illustrates those cases that meet both the straight discrepancy model criterion and the 
regression model criterion (designated as 1,1 in Table 14). 

Based on the information in Table 14 and the figures, it can be seen that very few 
cases are judged to be eligible by the regression procedure that are not also judged to be 
eligible by the straight discrepancy model. Thus, the overlap in the two models are 
basically those cases identified by the regression model. What is demonstrated in the 
column labeled "1,0" in Table 14 are the additionally substantial numbers of individuals 
that would be eligible under the straight discrepancy model. 

Educational Importance of the Study 

Differing from past presentations of the issues surrounding which model to use, 
the current study demonstrates very concretely the consequences that result when one of 
the three models studied is chosen as the preferred model for inclusion in procedures for 
identifying and qualifying students for LD services. The results of simulation studies 
conducted indicate that this inflation of qualification rates can range from 12 percent to 
3 1 percent when using the straight discrepancy model versus the regression discrepancy 
model depending on the score reliabilities for the two measures and the extent of their 
correlation. The graphic presentations and discussion highlight that the latter inflation 
rate for the straight discrepancy model is due to a hidden error that rnight be called a 
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"model misspecification error," i. e., using a model with an assumption that in reality one 
knows is not true. The model misspecification error occurs when we fit the straight 
discrepancy model to the aptitude/achievement scatter plot data assuming a correlation of 
1 .00 when in reality the correlation is somewhat, and in some cases substantially, below 
1 .00. The true discrepancy model is found to be acceptable relative to the rate with which 
persons would qualify, but the model is bias in identifying persons at the higher ranges of 
ability. 



The bottom line conclusion and advice to the field is that one needs to attend to 
the model being used and realize that individuals at different aptitude levels will qualify 
at different rates in the straight discrepancy and true discrepancy models with the model 
qualifying individuals at the higher aptitude levels at a greater rate. This effect is greater 
the lower the correlation of scores for the aptitude and achievement measures being 
paired. The tables and graphs presented provide concrete evidence of the consequential 
effects to be expected when one model is chosen for implementation over another model. 



Footnote 

1 . This study was supported in part by funds provided by the California Community 
College Chancellor’s Office. Opinions expressed herein are those of the authors 
and do not necessarily reflect those of the sponsoring agency. 
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Table 1 . Criterion discrepancy score size needed for each model and condition to qualify 
a student for services.. 



z-score=1.5 (7%) z-score=1.65 (5%) z-score=1.96 (2.5% ) 
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* A = Regression Discrepancy Model; 
B = Straight Discrepancy Model; 

C = True Discrepancy Score Model 
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Description for Tables 2-13 



Tables 2-13 indicate the percentage of students at different ability levels estimated to 
meet LD eligibility criteria using three different models: 

1) a regression discrepancy model, 

2) a straight discrepancy model, and 

3) a true score discrepancy model. 

Within each table, percentage values are given for different reliability values for the 
aptitude and achievement measures. These latter values evaluated were .95, .85 and .75 
for each measure. The total percentages also are given for students combined across 
ability groups for all students, students with ability scores greater than 79 and students 
with ability scores greater than 85. 

The differences from one table to another are defined by two parameters: 

1) the level of correlation between the aptitude and achievement measure 
(presented are values of .75, .55, .35 and .15) and, 

2) the cut-score (z-score) standard used to define a qualifying discrepancy 
(values were set at z-scores of 1.5 (approximately 7%), 1.65 (5%) and 1.96 
(2.5%)). 



The following identify the combinations of each of these latter values for each table. 



Table 2: 
Table 3; 
Table 4: 
Table 5: 
Table 6: 
Table 7: 
Table 8: 
Table 9: 
Table 10 
Table 1 1 
Table 12 
Table 13 



Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 
Aptitude/Achievement correlation = 



.75; z-score standard =1.5 (7%) 
.55; z-score standard = 1.5 (7%) 
.35; z-score standard = 1 .5 (7%) 
.15; z-score standard = 1.5 (7%) 
.75; z-score standard = 1.65 (5%) 
.55; z-score standard = 1 .65 (5%) 
.35; z-score standard = 1.65 (5“/o) 
.15; z-score standard = 1 .65 (5%) 
.75; z-score standard = 1 .96 (2.5%) 
.55; z-score standard = 1 .96 (2.5%) 
.35; z-score standard = 1 .96 (2.5“/o) 
.15; z-score standard = 1.96 (2.5%) 
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Table 2 - Aptitude/Achievement correlation = .75; z-score standard = 1.5 (7%) 
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Table 3. Aptitude/Achievement correlation = .55; z-score standard = 1.5 (7%) 
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Table 4. Aptitude/Achievement correlation = .35; z-score standard = 1.5 (7%) 
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Table 5. Aptitude/Achievement correlation = .15; z-score standard = 1.5 (7%) 
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Table 6 - Aptitude/Achievement correlation = .75; z-score standard = 1.65 (5%) 
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Table 7 - Aptitude/Achievement correlation = .55; z-score standard = 1.65 (5%) 
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Table 8 - Aptitude/Achievement correlation = .35; z-score standard = 1.65 (5%) 
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Table 10 - Aptitude/Achievement correlation = .75; z-score standard = 1.96 (2.5%) 



U 

o 2 

^ B 

W W 
03 

w : 

QJ X! 

a; 

o 

o; 

c: 

03 t3 



O 



§1 

o; 

03 

o 

>, 



JI5 

< 



(N 



-D 

.2 



0) 

T3 

O 



ERIC 



22.0 


o 

CO 




12.0 

1 - 


3.0 


q 

CO 




7.0 


3.0 


q 

CO 


q 

CO 


O 


o 




q 


q 


q 




q 


q 


q 


q 


O 


CO 




(N 


CO 


CO 






CO 


CO 


CO 


cq 






1-H 
















1-H 






q 


q 


q 




q 




q 




03 


(N 




1-H 


(N 


(N 




CD 


cq 


cq 


(ci 


1-H 






1-H 
















CX) 


03 




1-H 


q 


q 




q 


q 


CO 


q 


cx> 


d 




CD 


cq 








d 


(N 


CD 


00 






CSl 


1-H 






1-H 


1-H 






LO 


(N 




CO 










03 


q 


q 


00 










CO 






CO 


CN 




(M 






1-H 








d 






















1-H 














q 


1-H 


q 






q 


q 




rH 


(N 




t-H 


cq 


cq 




CD 


1-H 


cq 


cq 


(M 






1-H 


















CO 




CO 


q 


q 




q 




q 


q 




1-H 








1-H 








cq 


1-H 


rH 






















C£> 


00 






CO 


CO 






O 


CO 


CO 


d 






d 




1-H 




oq 




cq 




1-H 






















o 


t> 




q 


1-H 


t> 




CO 


o 


q 


q 


00 










1-H 




ci 




cq 




03 






CO 


1-H 


1-H 




q 


o 


q 




d 






CN 




1-H 




(N 




cq 




uo 


LO 




iO iO 


iO 


uo 




ID LO ID 


ID 


ID 


ID 


03 


CJ3 




00 c?3 


00 


03 




t> 03 00 


t> 


03 


00 


uo 


LO 




LO LO 


uo 


iO 




LD ID ID 


LD 


ID 


ID 


03 


<J3 




03 00 


03 


00 




<J3 t> 00 


<J3 




00 












>; 


1 












o 






CJ 


CJ 






CJ 


CJ 


CJ 




C 






C 


C 






C 


C 


C 




03 






cd 


cd 






cd 


cd 


cd 


o 

C 


a 

03 

U 

C3 




O 


a 

03 

U 

u 


1 a 

03 

U 

CJ 


( 


O 

C 


& 

03 

CJ 


a 

03 

CJ 


1 a 

03 

U 

CJ 


03 


03 




03 


CO 


CO 




Cd 


CO 


CO 


CO 


a 

(D 


Q 




a 

<D 


Q 


Q 




a 

03 


Q 


s 


Q 


CJ 


CD 




o 


03 


03 




CJ 


03 


03 


03 


W 


D 




CO 


D 


D 




CO 


D 


3 


3 




:h 








;h 




• p*^ 


u 


u 


u 


Q 






p 




H 




p 




H 


Eh 



5.0 


3.0 


q 

CO 


q 


q 


q 




CO 


CO 


q 


q 


q 




(N 


(N 




CO 


q 


cq 


d 




1-H 


1-H 




q 




q 


CD 




CO 


CO 


q 


q 


CO 


(N 


cq 


q 


q 


q 


(N 




1-H 




q 




1-H 




1-H 


CO 


1-H 


q 


1-H 




cq 


q 


o 


1.3 


ID 


ID 


ID 


t> 


t> 


00 


ID 


ID 


ID 


00 


00 












.CJ 


CJ 




3 


3 




3 


3 


o 

3 


a 

' 03 


a 

03 


U 


U 


C3 


C3 


3 


CO 


W 


a 

03 


‘Q 


Q 


CJ 


03 


03 


CO 


3 


3 


♦ pH 




u 


Q 


Eh 


Eh 



q 


q 


CO 


CO 


q 


q 


CO 


CO 






(N 


cq 


q 


q 


CD 


CD 


(M 


q 










(N 


cq 


q 


q 


1-H 


1-H 


CO 


CO 


q 


q 






.75 1 


.75 


.75 1 


.75 


Discrepancy 1 


True Discrepancy 



iz 



22 



Table 11 - Aptitude/Achievement correlation = .55; z-score standard = 1.96 (2.5%) 
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Table 12 - Aptitude/Achievement correlation = .35; z-score standard = 1.96 (2.5%) 
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Table 13 - Aptitude/Achievement correlation = .15; z-score standard = 1.96 (2.5%) 
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Table 14. Hit and miss rates (in percentages) when comparing models for students 
meeting eligibility criterion. 
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1.0 ' = percent of students selected by the straight (or true score) discrepancy model, 

but not by the regression model 

1.1 = percent of students selected by both models 

0,1 = percent of students selected by the regression model, but not the straight (or true 

score) discrepancy model 
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Figure 1 . Aptitude by Achievement Scatterplot for r (apt,ach) = .15; Dotted lines 

represent standard error eligibility criterion values (5% level) for the straight 
discrep^cy and recession models 
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Figure 2. Aptitude by Straight Difference Score Scatterplot for r (apt,ach) = .15; 

Horizontal lines represent maximum (reliabilities of .75) and minimum 
(reliabilities of .95) standard error eligibility criterion values (5% level) 



O 

ERIC 

27 



x”HOV X ddia 



26 




AB1 X 



Figure 1 . Aptitude by Achievement Scatterplot for r (apt,ach) = ,15; Dotted lines 

represent standard error eligibility criterion values (5% level) for the straight 
discrepancy and regression models 
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Figure 2. Aptitude by Straight Difference Score Scatterplot for r (apt,ach)-= .15; 

Horizontal lines represent maximum (reliabilities of .75) and minimum 
(reliabilities of .95) standard error eligibility criterion values (5% level) 
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Figure 5. Aptitude by Achievement Scatterplot for r (apt,ach) = .75; Dotted lines 

represent standard error eligibility criterion values (5% level) for the straight 
discrepancy and regression models 
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Figure 6. Aptitude by Straight Difference Score Scatterplot for r (apt,ach) = .75; 

Horizontal lines represent maximum (reliabilities of .75) and minimum 
(reliabilities of .95) standard error eligibility criterion values (5% level) 
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Figure 7. Aptitude by Regression Discrepancy Score Scatterplot for r (apt,ach) = .75; 

Horizontal line represents the standard error eligibility criterion values (5% 
level) 




Figure 8. Aptitude by True Difference Score Scatterplot for r (apt,ach) = .75; Horizontal 
lines represents the standard error eligibility criterion values (5% level) for 
reliabilities of .75 and .95 
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Figure 9. affaight Difference Score by Regression Discrepancy Score Scatterplot for r 
(apt,ach) = .15; Vertical lines represent maximum (reliabilities of .75) and 
minimum (reliabilities of .95) standard error eligibility criterion values (5% 
level) for the Straight Discrepancy Score model and the Horizontal line 
represents the standard error eligibility criterion values (5®/o level) for the 
Regression Discrepancy Score 
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Figure 1 0. Straight Difference Score by Regression Discrepancy Score Scatterplot for r 
(apt,ach) = .75; Vertical lines represent maximum (reliabilities of .75) and 
minimum (reliabilities of .95) standard error eligibility criterion values (5% 
level) for the Straight Discrepancy Score model and the Horizontal line 
represents the standard error eligibility criterion values (5% level) for the 
Regression Discrepancy Score 
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